Create a data pipeline

Understand the concepts and configuration details to create a data pipeline

📄️ Ingestion

Pipeline setup is a three step process:

📄️ Dedupe and Scheduling

Pipeline setup is a three step process:

📄️ Destination set up

Pipeline setup is a three step process:

📄️ Historical Load and Pipeline Concurrency

Once the pipelines have been setup, they will continue to run as per the schedule. However you might want to load the historical data due to one of the many reasons including:

📄️ Data dedupe

When ELT Data fetches your application data, it carries out the following transformations:

📄️ Data Flattening, Schema Management

Data Flattening and Normalization